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ABSTRACT 

The Atmospheric Radiation Measurement (ARM) 
program Raman Lidar (CARL) was upgraded in 2004 
with a new data system that provides simultaneous 
measurements of both the photomultiplier analog output 
voltage and photon counts. The so-called merge value 
added procedure (VAP) was developed to combine the 
analog and count-rate signals into a single signal with 
improved dynamic range. Earlier versions of this VAP 
tended to cause unacceptably large biases in the water 
vapor mixing ratio during the daytime as a result of 
improper matching between the analog and count-rate 
signals in the presence of elevated solar background 
levels. We recently identified several problems and 
tested a modified version of the merge VAP by 
comparing profiles of water vapor mixing ratio derived 
from CARL with simultaneous sonde data over a six 
month period. We show that the modified merge VAP 
significantly reduces the daytime bias, and results in 
mean differences that are within approximately 1% for 
both nighttime and daytime measurements. 

1. INTRODUCTION 

The Raman lidar (CARL) at ARM’s Southern Great 
Plains site is an autonomous, turn-key system [1] that 
has been operational now for 10 years. The system 
transmits at a wavelength of 355 nm with 300 mJ, 20 ns 
pulses, and a pulse repetition frequency of 30Hz. The 
detection system currently consists of 10 channels each 
with range resolutions of 7.5m. These include 2 water 
vapor channels at 408 nm, 2 nitrogen channels at 
387nm, 3 elastic channels, two temperature channels at 
354 and 353nm, and one liquid water channel [1]. The 
lidar has two fields-of-view (FOV), where in the wide 
field of view there are three channels (water vapor, 
nitrogen, and elastic) with a 2 mrad FOV, and the 
remaining the channels have a 0.3 mrad FOV. Data 
products derived from CARL include water vapor 
mixing ratio, aerosol scattering ratio, aerosol extinction, 
and linear depolarization ratio [2]. 

In 2004 the system underwent a major upgrade. As part 
of this upgrade the existing data system was replaced 
with new transient data recorders from Licel GbR 
(Berlin, Germany). The Licel recorders offer the 


advantage of increased dynamic range by providing 
simultaneous measurements of both analog 
photomultiplier current and photon counts. The new 
detection electronics enable water vapor profiling up to 
5-6 km AGL during the day, which is a marked 
improvement over the original version of this lidar (~3 
km in 1999). In order to take advantage of this 
capability, the so-called merge VAP was developed to 
combine the analog and count-rate signals into a single 
signal with improved dynamic range. This VAP 
represents the first critical step in the data processing 
chain for CARL. 

Earlier versions of the merge VAP resulted in large 
biases in daytime mixing ratios. As a result, this VAP 
was never implemented operationally within ARM’s 
data management facility, and with time the backlog of 
unprocessed raw data grew. Thus, the problem was 
recently elevated to critical status by the ARM 
community, and an intensive effort was launched to 
identify and remedy the problem in the merge VAP. 
This paper summarizes those efforts and the 
modifications that have been made which have resulted 
in a significant reduction of the daytime mixing ratio 
biases. 

2. MERGE ALGORITHM BASICS 

The first step in the merge process involves correcting 
the count-rate signal for pulse pileup effects. Assuming 
that the PMT and associated electronics obey the 
nonparalyzable assumption [3], this correction takes the 
following form: 


where CL is the measured count rate, and T is the 
deadtime parameter. The indices i and j are used to 
denote time and height such that CL = C(t i ,Z .) . 

Above its inherent noise floor the analog signal is 
assumed to be proportional to the “true” count rate. The 
so-called virtual count rate is defined as 
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where Ay is the analog signal. The slope, , and 

offset, O i , are referred to as the glue coefficients 
(GC’s). A single set of GC’s are determined for each 
profile. Thus, S f , and O i are, in general time- 
dependent and height-independent. 

The merged signal is obtained by combining the virtual 
and corrected count rate data such that 
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where C max is a prescribed transition threshold. The 

merged signal incorporates the superior sensitivity of 
the count rate data in the weak signal regime, and the 
improved linearity of the analog data in the strong 
signal regime. 

2.1 Glue Coefficients 

The GC’s are determined by linear regression while 
constraining the fit range. In the regression the range of 
Cy is restricted such that 


C bl +SC<C’ ij <C 
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where C hj is the mean count rate of the solar 

background, and SC is a prescribed parameter that 
determines the lower threshold relative to the solar 
background. In our current implementation we use 
SC = 0.5 MHz. This helps to suppress the impact of 
the background signal in the regression. 

The upper limit of the fit range is determined by the 
transition threshold, C max . It is necessary to impose 

this limit because equation (1) represents an 
approximation that is only applicable for small signals, 
i.e. for zCy « 1 . Thus, C max should be set to a small 

value in order to satisfy this condition. However, C max 

must also be large enough to ensure an adequate fit 
range for the regression. These two conflicting 
requirements create problems for the determination of 
the GC’s during the daytime for the solar-sensitive 
channels. As the solar background increases during the 
daytime the fit range is reduced. This is particularly 
problematic for the water vapor channel since this 
channel exhibits the greatest sensitivity to solar 
radiation. 


In our current implementation we use C max =50 MHz. 
Even with this relatively large value of C max there are 
long periods during the day when C hj + SC > C max 

for the water vapor channel. During these periods it is 
not possible to derive the GC’s. We are forced instead 
to simply interpolate through the daytime voids, as 
illustrated in Figure 2. 

2.2 Analog signal delay 

One potential pitfall associated with the use of the Licel 
data recorders is the inherent phase shift of the analog 
signal with respect to the count-rate signal. Electronic 
processing of the analog signal induces a slight delay 
relative the count-rate signal. If this shift is not properly 

account for it can adversely affect C ( , ” £ ’ ,gl . 

Licel units were installed in all of the existing detection 
channels as part of the major upgrade in 2004. All of 
these original units produced the same delay or phase 
shift, i.e. the analog signal was delayed by 3 range bins 
(—150 ns) relative to the count rate signal. The 
following year three new channels (and three new Licel 
units) were added for temperature and liquid water 
profiling [4]. These newer Licel units produced delays 
of 8 range bins (~400 ns). However, the difference was 
not immediately detected and the merge code continued 
to assume a shift of three bins for all channels. This 
problem has since been fixed and we have made it 
standard practice to check the phase shift whenever a 
new Licel unit is added to the system or when units are 
swapped between detection channels. 


3. BASELINE VS MODIFIED MERGE VAPS 
3.1 Regression method 

In the original or baseline implementation the GCs are 
determined from a linear regression between Cy and 
Cy . This is equivalent to minimizing 



(5) 


with respect to S, , and O j . The measurement error is 
assumed to be proportional to the count-rate. Therefore, 
we set cr„- = C n . 

In the baseline merge VAP the GCs are determined by 
treating Cy as the dependent variable in the linear 

regression, while truncating its range according to 
equation (4). This truncation can cause biases in the 
GCs when there is significant scatter in the data, as 



illustrated in Figure 1. This problem has been addressed 
in the modified merge VAP by simply reversing the 
roles of the analog and count-rate data in the linear 
regression. In this approach the count-rate data are 
treated as the independent variable. Thus, in the 
modified merge VAP the GC’s are obtained by 
minimizing 

J = ^ (4~WQ- | -d ) ) 2 (6) 
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with respect to s' and o\ . Here, the measurement error 
is assumed to be proportional to the analog signal. Once 
S^ and o' are determined, the GC’s are computed 

from .S' ( = 1 / s' and O i = — o' i S i . These results are 

then used to compute the virtual count-rate, C„ . The 

u 

signals are then merged, as in the baseline method, 
using equation (3). 

Figure 1 illustrates the effect that this modification has 

on the virtual count rate, C (/ . This particular example 

shows results from the wide-field-of-view water vapor 
channel during a late morning period on 16 August 
2007. The baseline regression method clearly produces 
slopes that are biased toward lower values as a result of 
the truncation in the dependent variable. 


water_low, 20070816, 16:00:00 



Figure 1. Solid and dashed lines show the virtual count-rate 
as functions of the analog signal for the modified and 
baseline merge algorithms, respectively. The darker points 
fall within the fit region as defined by equation (4). 

Figure 2 shows time series of the slope, S n for the 

baseline and modified merge VAPs. The modified 
merge VAP exhibits much less sensitivity to changing 
solar background. In fact. Figure 2b suggests that a 
simple approach based on the use of constant GC’s may 
be adequate to describe the virtual count-rate. 
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Figure 2. Time series of the slope, s, for (a) the baseline 
merge VAP, and (b) the modified merge VAP. These 
examples were taken from the wide-field-of-view water 
vapor channel on 16 August, 2007. The solid lines are 
obtained by smoothing the beam-to-beam slopes (gray dots). 
The dotted lines are obtained by linear interpolation of the 
smoothed slopes. 

3.2 Determination of % 

For the modified merge VAP the deadtime parameters 
are estimated by applying a slight generalization of the 
regression technique discussed in section 3.1. The 
generalization involves minimizing equation (6) with 
respect to s' , o' and T . In this approach we seek the 
value of T that results in the best linear fit between 
Cj and C[j over fit range defined by equation (4). The 

deadtime parameter obtained using this technique is 
consistent with the regression method that is used to 
determine the GC’s. Additionally, this technique is 
applied using data from an entire diurnal cycle. This 
permits us to estimate T for the water vapor channel by 
taking advantage of the range of signal caused by the 
changing solar background. 

4. WATER VAPOR MIXING RATIO 

This section presents comparisons of lidar derived 
water vapor mixing ratios to simultaneous radiosonde 
measurements. Raw lidar data were processed using the 
baseline and modified merge VAP over a six month 
period from 1 April to 30 September 2007. The output 
from these VAPs were then processed using the same 
code (rlprof_mr) to generate two different mixing ratio 
data sets. For these comparisons the modified merge 
VAP was configured to use only the nighttime average 
GC’s, while the baseline merge VAP used diurnally 
varying GC’s. 






Figures 4 and 5 show profiles of the average ratio of the 
lidar to sonde mixing ratio derived from the baseline 
and modified merge VAPs, respectively. Sonde 
humidity data were scaled with a height-independent 
factor in order to force agreement with measurements 
of precipitable water vapor (PWV) from a nearly 
colocated microwave radiometer. This helped to largely 
remove any diurnal bias in the radiosonde humidity 
profile [5]. Only soundings during clear periods were 
used in the comparisons. Daytime and nighttime 
profiles were separately averaged based on the solar 
background level in the wide-field-of-view water vapor 
channel. There were a total of 157 daytime and 143 
nighttime soundings used in these comparisons. 

Both the baseline (Fig 3) and modified (Fig 4) merge 
VAPs produced mixing ratios that agree with the sonde 
data to within approximately 1% during the nighttime. 
Flowever, the baseline merge VAP exhibits a difference 
of about 4% between the daytime and nighttime bias. 
By contrast, difference between the daytime and 
nighttime biases for the modified merge VAP is about 
1 %. 
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Figure 3. Results using the baseline merge VAP. Profiles of 
the average ratio of the CARL-to-sonde mixing ratio for (a) 
nighttime and (b) daytime soundings. The solid lines indicate 
the value of the vertically averaged CARL-to-sonde ratio. 
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Figure 4. Results using the modified merge VAP. Profiles of 
the average ratio of the CARL-to-sonde mixing ratio for (a) 
nighttime and (b) daytime soundings. The solid lines indicate 
the vertically averaged CARL-to-sonde ratio. 


5. SUMMARY 

Recent modifications to the so-called merge VAP have 
been shown to reduce the daytime biases in mixing 
ratios derived from CARL. The CARL and sonde 
mixing ratios are in agreement to within approximately 
1% on average for both nighttime and daytime 
measurements. These modifications enable operational 
processing of the Raman lidar to begin, thus removing 
the bottleneck in the data processing chain that has 
existed since the new data system was installed in 2004. 
The modified version of the merge VAP is currently in 
production within the data management facility at 
Pacific Northwest National Laboratory and merge data 
are being generated and made available to the user 
community through the Atmospheric Radiation 
Measurement program web site ( http://www.arm.gov/ ). 
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